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Abstract 

■ In this work we present a class of functions, motivated by gap functions, which we call 
f-*) I G-coupling functions. We will show that these functions can generate a duality scheme 

■ for minimization problems by means of the general conjugation theory. Thanks to this 
scheme, a Lagrange-type function is introduced as well. 
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1 Introduction 

. For solving non-convex optimization problems, a tool that is becoming more important 

\mJ I is generalized conjugation. In ^ the G-coupling functions are introduced in finite di- 

■ mensional spaces. Here we extend this definition to the infinite dimensional case. These 

"j^ \ coupling functions will allow us to see duality schemes in a different way. The usual the- 

ory found in the literature ([6], [H], and references therein) are related to a fixed coupling 
function, but here we consider (for a specified function /) a family of coupling functions. 



^ . These coupling functions are motivated by gap functions. It is interesting to point 

QQ ■ out, that many of these (gap) functions have similar properties. However, in some cases 

. they are functions of one vector and it is important, since they are linked to specified 

I optimization problems, that those functions have zeros. 

I On the other hand, G-coupling functions will be defined as functions in two variables 

and they might not have zeros. Even more, given a specified proper function /, it is 
shown that a certain sub-family of this family of coupling functions satisfies many inter- 
esting properties. 
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^ ■ In Section 2, we describe how many gap functions have similar properties, which are 

^ . useful for the definition of G-coupling functions. 

In Section 3, it is found the definition of G-coupling function with properties related 
to generalized conjugation using this family of functions and a fixed proper function /. 

In Section 4, it can be seen how these ideas generate Lagrange-type functions (see [7]). 



2 Motivation 



In several works already published, there can be found definitions of GAP functions for 
particular problems. Now we present 2 concrete examples. 

In [2], the Variational Inequality Problem is studied: 

(VIP) Find xo G C, such that, 3y* G T{xo) with {y*,x- xq) > Vx G C, 

where T is a maximal monotone correspondence which is defined as follows: given a point 
to set map, T, it will be said that it is a maximal monotone correspondence if it satisfies 
that {u — v,x — y) > for every u G T{x), v G T{y) with x,y C and if there exists v, 



such that {u — v,x — y) > 0, for ah x,y S C and for all u E T{x), then v S T{y). The 
corresponding GAP function is then defined as follows: 

hT,c{x) := sup {v,x-y), 

where Gc(T) = {{v,y) : v G T(y), y £ C} and C is a non-empty closed convex set. This 
function happens to be non-negative and convex, and it is equal to zero only in solutions 
of (VIP). 

In [8], the Equilibrium Problem is studied: 

(EP) Find x e K, such that f{x,y) > 0, Vy G K, 

where K C JR" is a non-empty closed convex set and f : K x K ^ M is a function that 
satisfies: 

i) f{x,x) = 0, for all x £ K. 

ii) f{x, ■): K ^ IR is convex and l.s.c. 

iii) f{-,y) : K ^ IR is u.s.c. 
The GAP function is defined as: 

[sup f{x,y) if y £ K 

9f{y) ■■= < 

[ +00 in other case. 

In this case, the function gf is non-negative, convex and l.s.c. and if it vanishes at xq, 
then Xq is a solution of (EP). 

In these examples, gap functions are used to transform a special Equilibrium Problem 
(for example, the VIP is a particular case of an EP) into a minimization problem. 

Now our attention is focused in using coupling functions that could be related, at 
least in some general aspect, to GAP functions. Therefore these functions must link both 
primal and dual variables. Since these coupling functions must be related to a sense of 
"gap", we consider these functions as non-negative and with 2 arguments. 

Let us remember that for the minimization problem, the convex conjugation theory 
allows us to generate a dual problem and there is implicit another concept of gap function 
(see [l], [3] and [5]): consider 

a = inf[/(x) : X G iR"]. (P) 
Define a function : IR^ x IRP — > ]R, where IR = MU {— oo, +oo}, satisfying 

^{x,0) = /(x), Vx G iR". 
Then (p will be called a perturbation function and the function h : — > M defined by 

h{u) = inf (p{x,u) 

will be called the marginal function. Observe that 

a = h(0) = inf 09(2;, 0) = inf f(x). 

Considering now /i**, the convex bi-conjugate (see [5j) of h one has: 

/i**(0) < /i(0) = a 



where 

h**{0) = sup[(u*,0) - h*{u*) : u* G IRf]. 
Then, making —f3 = h**{0), one has 

/3= inf h*(u*). (Q) 

(Q) is called the dual problem of (P) and in general we have —(3 < a. It is said that there 
is no duality gap whenever h**{0) = h{0). It is easy to prove that h*{u*) = ip*{0,u*), and 
if we define the function k : IR^ — )• iR by k{x*) := inf^ (p* {x* ,u*), then /3 = A;(0). 

This analysis is summarized in the following scheme: 

a = inifix) (P) /3 = inf/i*(n*) (Q) 

<f{x,o) = /(x), VxeiR" f*{o,u*) = h*{u*), yu* e MP 

h{u) = ini ip{x,u) k{x*) = inf 99* (rc* , u* ) 

a = h{0) /3 = k{0) 

-P < a. 

If h is proper and convex, a necessary and sufficient condition for ensuring that there will 
be no duality gap (— /3 = a) is that h be l.s.c. at (in general if l.s.c. does not imply that 
h would be l.s.c). 

Further more, if h is convex, l.s.c. and € ri{dom{h)), then a = — /3 and the dual 
problem has at least one optimal solution, and if u* is an optimal solution of (Q) and 
if = if**, then 

X is an optimal solution of (P) <^=^ f(x) + h*{u*) = 0. 
Consider now the function g : IR^ x IW — > ]R defined by: 

g{x,u*) = f{x) + h*{u*). 

This function vanishes at {xq,Uq) if and only if xq solves the primal problem and Uq solves 
the dual one. In addition, this function is non-negative and if the first variable is kept 
fixed, the function is convex and l.s.c. It is clear now, which properties are satisfied for 
many gap functions. 

3 G-coupling Functions 

As stated before, G-coupling functions are first introduced in |4J for finite dimensional 
spaces. We are going to extend this notion for arbitrary Banach spaces. 

Henceforth, we consider two arbitrary Banach spaces X and Y. 

Definition 3.1 ^ non-negative function g : A x B ^ M, with A x B C X x Y will be 
called a G-coupling function if 

(Dl) inf o(x,y)=0. 

xdA, y€B 

Define 

g is a G-coupling function}. (1) 

Not every G-coupling function has zeros: 
Example: Define on X x y 

g{x,y) = exp(||x|| - \\y\\). 



Then g G T ' is continuous and it does not have any zeros. 

Let us turn our attention now to how the family of functions J^^'^ will allow us to es- 
tablish duality schemes in (at least for now) the minimization problem. It is important to 
point out that in the following we consider an unusual type of duality, f : A iRU {+00} 
is kept fixed and g € J-^'^ , for a given B dY , \s variable. 

Consider a proper function f : A ^ ]RU {+00}. For a given B C Y take g € T^'^. 
Define : B ^ JRU {+00} and /^^ : A ^ ML) {+00} as follows (for example see [6] and 
references therein): 

/3(y) := sup{g{x, y) - f{x)} Vy G B, (2) 
f39(x) := snp{g{x, y) - f9{y)} Vx € A. (3) 

In some cases, it would be better to consider a (7 G F^'^ which satisfies: 
(D2) B is convex and g{x, ■) : B M is a convex and l.s.c. function for each x in A. 
With this, we have the following: 

Lemma 3.1 Let f : A ^ i??U{+oo} be a proper function and given B CY take g G T^'^ . 
Then 

f\y) + fix) > g{x, y) > 0, V(x, y)eAxB, (4) 

which implies 

f{x)>-f3{y),y{x,y)eAxB. (5) 
Moreover if g satisfies {D2), then f^ is a convex l.s.c function. 

Unless it is mentioned, not every g € J-^'^ satisfies {D2). 

It would be interesting to know which condition either a G-coupling function g or the 
function / must satisfy in order that the function be proper, because with this one 
would have a non-trivial function related to /. The following lemma ensures the existence 
of such a function g € T^'^ for any B cY, taking as a starting point a natural condition 
on / which must be imposed if / is the objective function of a minimization problem. 

Lemma 3.2 Let f be as before. Then f is bounded from below if and only if, for every 
non-empty B cY , there exists g G J^^'^ such that f^ is proper. 

Proof: 

• Suppose that inf / > —00, then for a non-empty Bq C Y fixed, consider g G J^^'^o 
as follows: 

9{x,y) = \\y\\, y{x,y) e Ax B. 

Thus 

f^iy) = - inf/ Vy Gi?o, 

which is clearly a proper function and since Bq cY was fixed arbitrarily, the result 
is satisfied for every B cY. 

• Take a non-empty Bq C Y and g G J^^^^o g^ch that is proper. Let us suppose 
that inf / = —00, from [6] we can see that this implies that inf /^^ = —00. Then: 

-cx) = inf f 99 = inf I sup [g{x,y) - f9{y)]] > 

sup (mfMx,y) - f9{y)]) > sup (-/^(y)) = - inf /^(y), 

which means —00 > — inf (f9[y)). Then inf /^(y) = +00, which implies that f9 is 
yeBo yeBo 

not proper and we have a contradiction. Therefore we must have that inf / > — 00. 



Notice that this proof also states, in particular, that there exists g G T^'^ for every non- 
empty B cY which satisfies {D2) and is proper. 

Given non-empty sets A C X and C y, let 

jr^ :={/ : A ^ JRU {+00}, / is proper, inf / > -00} (6) 
and jgj : A X B MU {+00} defined by: 

7gjix,y):=fix) + f^iy) (7) 
with g e J^^'^ and f ^ . Take / S 7"^ and define 

Tf^ := {g G T^'^/fS is proper and inf 7^,/ = 0}. (8) 

Remark: Observe that ^gj might not be in T^'^, since can take the value +00 for 
somewhere in ^ x 

Lemma 3.3 J^j ' is non-empty for all non-empty B cY. 
Proof: Given a non-empty B cY, define g G J-'^'^ by: 

g{x,y) = \\y\\- 

It is easy to check that g belongs to J~^'^ (this example also proves that there are functions 
in J~f'^ which satisfy {D2)). 

Now consider 

(P) mmf(x) (9) 

X 

with / G J-"^. Taking g G J~f'^} define the dual problem related to g: 

(Dg) min/^(y). (10) 

yeB 

Since 

{x,y)&AxB xeA yeB 

then 

inf /(x) = - inf /^(x*) = sup[-r(y)]. (11) 

xsA j/e-B y^B 

This means that there is no duality gap between the primal problem (P) and its dual {Dg) 
for every g G ^f'^- 

Theorem 3.1 Let g G ^f'^- Then y is a solution of {Dg) and x is a solution of (P) if 
and only if jgj{x,y) = 0. 

Proof: X and y are solutions of (P) and (Dg) respectively if and only if 

fix) = inf / = - inf = -f^{y) ^ fix) + ^(y) = 7<;,/(x,y) = O.n 



Remark: The previous result suggest us that the function 7^ j can be seen as the GAP 
function of problem {P) and its dual {Dg). 

The next theorem states that given non-empty sets A C X and B cY, the correspon- 
dence defined by 

F: =1 ^^'-s 



/ ^ F(/) = 7-/'^, 



is a closed correspondence (see [9]). 



Theorem 3.2 Take f ^ (A C X is non-empty) and a non-empty B C Y . If there 
exist fk ■ dom{f) M, gk ■ A x B ^ M, sequences of functions (k & JN), such that: 

i) fk converges uniformly to f in dom{f). 
a) gk & T satisfies {D2) for every k E ]N. 
Hi ) gk converges uniformly to a function g in A x B. 
Then g G F^'^ and it satisfies {D2). 

Proof: Let us prove first that g G T"^'^. Since g^ converges uniformly to g, given £ > 0, 
there exists N E ]N such that if k > N then 

\9kix,y)-g{x,y)\<e, y{x,y)eAxB. 

Hence gk{x, y) - e < g{x, y) < gk{x, y) + s, V(x, y) € Ax B. 

Taking inf (remember that inf ^fji; = for all k € IN): 
x,y 

—£ < ini g{x,y) < e. 
x,y 

Then | inf g'l < e. And since e > is arbitrary, one has that inf = 0. This proves that 
g G 

Now we prove that g satisfies {D2). We need to prove that g{x, ■) : B — >■ iR is convex and 
l.s.c. for all x € A. Let xq G Ahe fixed arbitrarily. 

• g{xo, •) is convex: since for all k G IV, gk{xo, •) is convex, one has that given yi,y2 S 
S and i G [0,1]: 

gk{xo,tyi + (1 -t)y2) < tgk{xo,yi) + (1 - t)gk{xo,y2). 

Making A; — > +oo: 

g{xo,tyi + (1 - t)y2) < tg{xQ,yi) + (1 - t)g{xo,y2), 

which proves that g{xo, ■) is convex. 

• g{xo, ■) is l.s.c: fix yo G -B and take A < g{xo,yo). There exists N e IN such that 

\gN{x, y) - g{x, y)\<£, V(x, y) eAx B, 

where 

2 

Hence A < A + e = g{xo,yo) - £ < 5'7v(xo,yo)- 

Since gN{xo, •) is l.s.c, then there exists V{yo) C -B, a neighborhood of yo, such that 
if y G y(yo) then 

A + £ < gN{xo,y). 

Reducing g{xo,y): 

X + e - g{xo,y) < gN{xQ, y) - g{xo,y) < e. 

Therefore, if y G Viijo), then A < g{xo,y). Thus g{xo, •) is l.s.c. in yo G B, and since 
yo was fixed arbitrarily then g{xo, •) is a l.s.c. function. 



We have proved that for a fixed xq S A, g{xQ, •) is a convex l.s.c. function, and since xq 
was fixed arbitrarily we have proved in fact that g E J-"^'^ satisfies {D2). 

It remains to prove that g G J^f'^- Foi" doing this, let us show that {fl^)k<^iN converges 
uniformly to (in B). 

Let e > and TV G IV be such that if > iV then 

\gk{x,y) - g{x,y)\ < |, y{x,y) e Ax B 

and 

\fkix)-f{x)\ < |, Vx G domif). 
Fix k > N and take y € B arbitrarily, then 

ftiy) ~ I < 9k{x',y) - fk{x'), for some x' G dom{f). 

Hence 

/f (2/) - e < gk{x',y) - A(x') - - < g{x',y) - f{x') < f^y), 

and so 

/f (y)-e<r(y). (12) 
This proves that ffj'{y) — f^{y) < £• On the other hand: 

/^(y) ~ I < 9ix",y) - f{x"), for some x" G dom{f), 

whence 

f^y) - e < g{x", y) - f{x") - | < gk{x", y) - Ux") < /f (y), 

and so 

r{y)-e<ft(y)- 

This shows that 

-e</f(y)-r(y). (13) 

Since y & B was fixed arbitrarily, thanks to ()12p and ()13p we have that 

-e < fi'^iy) - f^{y) < e, for every y e B. 

This proves that {f^'')k€iN converges uniformly to (in B), and it is immediate to see 
that is proper and 

< fix) + ny) < fk{x) + ftiy) + e, y{x,y) e dom{f) x B, 

where e > is arbitrary and k is large enough. Taking inf one has: 

{x,y)eAxB 

0< inf (/(x) + r(y)) <e. 

(x,y)eAxB 

Therefore inf (/(x) + f^y)) = and 5 G -F^'^.n 

{x,y)£AxB ■' 

This theorem proves a more difficult situation, the case when gj. G ^f^^ satisfy {D2) 
for all k G IN. For the general case, just omit the two • items and change B for a non- 
empty set. 

At this point a natural question arises, for given / G J^"^ and g G ^f'^, would be there 
any kind of relation between the optimal points and the optimal values of / and The 
next lemma answers this. 



A. B 

Lemma 3.4 For a fixed non-empty B CY and every g ^ J^f' ? the following are satisfied: 
i) inf/ = mf/5fl, 

a) if xo is a global minimum of f , then xq is a global minimum of f^^. 
Proof: Remember that /^^ is defined by: 

/^^(x) = sup{5(x,j/)-/«(y)}. 

yes 

i) inf fss < inf / is always true. On the other hand 

f'{y) + f''{x) > 9{x, y)>0,yxeA, ye B, 

which impUes that 

inf /^^(x) > - inf /^(y). 

But, since g E T^' one has that 

inf/=-inf /^(y), 
yeB 

which means 

inf / < inf < inf/. 

Therefore inf / = inf /»». 

ii) /^^(^o) < f{xo) = inf / = inf /»» < f^K^o), then /^^(xo) = inifaa. 

A B 

4 Lagrangians induced by ' 

Take / G J^^, a non-empty B C Y , g & ^f'^ and consider 

(P): inf/(x). 



Recall that 



is the dual problem of (P) related to g. Define L\ : IRP x C ^ MU {+00}, as follows: 

Li{x,y):=f{x)-g{x,y). (14) 
This function has some interesting properties: 
Theorem 4.1 

sup inf Li{x,y) = inf supLi(a;,y). (15) 
Proof: The inequality sup inf Li{x,y) < inf supLi(a;,y) is always true. For the opposite: 

Li{x, y) = f{x) - g{x, y) < f{x), y{x, y)eAxB, 

then 

supLi{x,y) < f{x), Vx G A. 
yeB 



It follows that 



inf supLi(a;,j/) < inf /(x). 
xeAy^]^ xeA 



But, since g Tj' , we have that 

inf f{x) = - inf = - ( iiiH su];)[g{x,x*) - f{x)] \ I 
=^ inf f{x) = sup inf Li{x,y), 

which means, 

inf supLi(x,y) < sup inf Li{x,y). 

Finally, 

sup inf Li(x,y) = inf sup Li(x, ?/).□ 

We are interested now in which properties are satisfied for every saddle-point of Li 
Remember that {xq, i/q) G A x i? is a saddle point of Li if and only if 

Li{xo,y) < Li{xo,yo) < Li{x,yo), V(x,y) £ Ax B. 

Proposition 4.1 Let Li be as before, if there exists (xo,yo) A x B saddle point of Li 
then: 

i) Xq G dom{f). 

ii) 2/0 "is an optimal solution of [Dg). 

Ill) f39{xo) = f{xQ). 

Proof: 

i) This is immediate thanks to the definition of saddle point. 

ii) From the previous theorem and the definition of saddle point, we have that 

LiixQ^yo) = sup inf Li(x,y) = inf sup Li(x, y). 

But 

sup inf Li(x,y) = - inf /^(y), 
Li{xo,yo) = inf Li(x,7/o) = -f^ivo)- 



moreover 
Thus, 



f^{yo)= inf 

S/GB 



iii) /^^(xo) = sup[g{xo,y)-f^{y)] = sup 

yeB y&B 



g{xo, y) - sup[5r(z, y) - f{z)] 
zeA 



. Which means, 



f39{xo) = sup mf [g{xo,y) - g{z,y) + f{z)] = sup mf [g{xo,y) + Li{z,y)]. 

y(zBz£A y^B^&A 

This implies 

/55(xo) > inf [^(xcyo) + -^^i(^,yo)] =9{xQ,yQ) + inf Li(z,yo), 

2GA 2GA 

but since (xo,yo) is a saddle point of Li, then inf Li(z,yo) = ^1(2^07 yo)- With this, 

2GA 

we have that 

/^^(xo) > gixQ.yo) +Li(xo,2/o) = fixo), 

which means /^^(xq) > f{xo)- f^^{xo) < f{xo) is always true (see [6j and references 
therein). □ 



Proposition 4.2 If xq is a solution of (P) and Xq is a solution of {Dg), then {xq,Xq) is 
a saddle point of Li . 

Proof: This is immediate from 

< g{xo,x*o) < f{xo) + f9{x*o) = =^ g{xo, x^) = O.n 

In Proposition 14.11 we would like to improve the fact that, in general, for every saddle 
point (xo,yo) e ^ X i3 of Li we have that f^^{xo) = /(xq). For doing this, we impose an 
additional condition over g. 

Proposition 4.3 Let g G Tf'^ be such that inf g{x,y) = for every x & A. The 

J y&B 

following are equivalent: 

i) {xQ,yo) is a saddle-point of L. 

a) xq is a solution of (P) and yo is a solution of {Dg)- 
Proof: The implication ii) =^ i) is true thanks to the previous Proposition. 
Consider now {xo,yo) a saddle-point of Li, then 

Li{xo,y) < Li{xo,yo), Vy G B, 

which is equivalent to 

f{xo) - g{xo, y) < f{xo) - g{xo, yo), \/y e B 
t 

g{xo,yo) < g{xo,y), Vy € B. 



Finally 

On the other hand 
This implies that 



g{xo,yo) = inf g{xo,y) = 0. 



Li{xo,yo) < Li{x,yo), Vx G A. 



fixo) < fix) - g{x,yo), Vx G ^ 



(remember that g{xQ,yo) = 0). Taking inf we have 

f{xo) < -nyo). 

And thus /(xq) = —f^{yo)-, which means that xq is a solution of (P) and yo is a solution 

of {Dg). 

Remark: To prove that there exists a 5 G J-f'^ such that inf g{x, y) = for every 
x G A just consider the trivial function g = 0. 



Examples 

For these examples, consider X = M", h : X IR^, 

A:= {xeX : h{x) < 0} 

and / : ^ iR. 

1. Classical Lagrangian 

Let Y = iR™ and h be such that hi : iR" Mis convex and l.s.c. for alH = 1, . . . ,m. 



Consider 



(CP) : min/(x), 



where / is convex and l.s.c. 

Remember that (see [Ij and ^) the following is the well known dual problem: 

(Dl) : minsup{(A*,-/i(x))-/(x)}, 

h{x) = {hi{x), . . . , hm{x)). Moreover, xq is a solution of {CP) and Aq is a solution 
of {Dl) if and only if (xq, Aq) is a saddle point of the Lagrangian function L, given 
by 

L{x, A*) := f{x) + (A*, /i(x)), X G A, A* G iR™. 
Taking B := JR"^, define g : A x B ^ IR as follows: 

g{x,X*):={X*,-h{x)). (16) 
It is not difficult to show that ^f'^ and, even more, 

P{X*) = sup{(A*, -h{x)) - f{x)}, X* G B. 

xeA 

Therefore, using G-coupling functions, we have recovered the classical lagrangian 
duality. 

2. Non-linear lagrangian function 

In [7j we find the following well studied case of a non-linear lagrange-type function: 

L{x,u) = f{x) + max{{uJo,h{x)), {u;p,h{x))}, 
where x G iR" and w G (iR™)i+P {p G M). 

If we consider Y = {M^f+P and B = {]R'^)^+p, define g : A x B ^ M as follows: 

g{x,uj) := m.m{{—h{x),ujo), . . . , {—h{x),ujp)), x £ A, uj £ B, (17) 

we will have that g G J-j ' and the lagrangian function induced is the same 
Lagrange-type function given by [7]. 
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